Method and apparatus for adaptive power management of memory subsystem

ABSTRACT

A method and apparatus are disclosed for performing adaptive memory power management in a system employing a CPU and a memory subsystem. A CPU throttle control (THR) module generates a CPU throttle control signal indicating when the CPU is idle. A memory controller (MC) module generates memory power management signals based on at least one of the CPU throttle control signal, memory read/write signals, memory access break events, and bus master access requests. Certain portions of the memory subsystem are powered down in response to the memory power management signals. Memory power management is performed on a time segment by time segment basis to achieve efficient power management of the memory subsystem during CPU run time.

This application is a continuation of U.S. application Ser. No.10/163,746 filed Jun. 5, 2002, now U.S. Pat. No. 7,028,200.

RELATED APPLICATIONS

The present application claims priority to and the benefit ofapplication Ser. No. 10/146,554, filed on May 15, 2002, now U.S. Pat.No. 7,010,708, and incorporates said application herein by reference inits entirety.

BACKGROUND OF THE INVENTION

Advanced CPU's and embedded processors are achieving higher performanceas time goes on. However, memory subsystems are requiring lower latencyand more bandwidth to sustain performance. Dynamic random access memory(DRAM), for example, is getting faster in clock speed, wider in bussize, and larger in capacity. As a result, DRAM is consuming more powerand generating more heat. The wider bus effectively increases the memorysubsystem power consumption linearly, whether it is for embeddedappliances, Desktop/Notebook PC's, or high-density Server applications.

A CPU is the computing and control hardware element of a computer-basedsystem. In a personal computer, for example, the CPU is usually anintegrated part of a single, extremely powerful microprocessor. Anoperating system is the software responsible for allocating systemresources including memory, processor time, disk space, and peripheraldevices such as printers, modems, and monitors. All applications use theoperating system to gain access to the resources as necessary. Theoperating system is the first program loaded into the computer as itboots up, and it remains in memory throughout the computing session.

Typical PC systems use either 64-bit or 128-bit DRAM subsystems. In thelatter case, the memory subsystem is usually organized as twoindependent 64-bit memory controllers (MC). Various types of DRAM may bepowered down through either a physical power-down signal, such as aclock enable CKE signal, or through a packetized power-down command sentthrough a high-speed serial bus.

For double data rate (DDR) synchronous DRAM, for example, de-asserting aCKE signal (low) puts the corresponding memory row of the DRAM into apower down state. Asserting the CKE signal (high) brings the memory rowback to a full operating state. The CKE signal may be dynamicallytoggled on every rising edge of the SDRAM clock.

A typical 64-bit memory controller (MC) may support between two and fourSDRAM dual in-line memory modules (DIMM). Each DIMM has up to two memoryrows (each side of a double-sided DIMM is called a memory row), and eachmemory row may have multiple internal memory banks. Each bank comprisesmultiple memory pages, one page from each DRAM chip of the memory row.

Typically, if a MC may put each memory row of multiple DIMM modulesindependently and dynamically into and out of the power down statesusing the CKE signal, then the MC is said to support dynamic CKE DRAMpower management. However, dynamic CKE is typically supported only inpower-sensitive appliances such as notebook PC's or PDA's and is notavailable for desktop PC's for various reasons.

Even for mobile designs, system designers have not been aggressive inDRAM power management since it would mean turning on an auto pre-chargeoption that pre-charges and closes a given DRAM bank after every accessif there is no pending access to the bank. However, if the CPU or a busmaster initiates an access to the same bank after it has been closed, alonger latency will be incurred due to row-to-column delay. If an accessis initiated immediately after the auto pre-charge is started, anadditional delay will be incurred due to the pre-charge.

It is known that some MC's perform selective auto pre-charging that useleast recently used (LRU) or other algorithms to close only those rowsthat are most unlikely to be accessed next, in order to minimizeincurred latencies. It is also known that some implementations look intoa read/write command FIFO to determine which banks to close to minimizethe latency impact. This may be effective but still cannot predict whichmemory banks will be accessed next. Some power management schemes alsouse certain statistical and prediction methods to determine which memorybanks will be accessed next but are not maximally effective.

An operating system may keep track of the percentage of time that theCPU is idle and writes the idle percentage value to a register. Forexample, the CPU may have been idle for about 40% of a last predefinedtime period. Different operating systems use different windows of timeto compute the idle percentage value. Older operating systems havelonger idle loops. Newer operating systems have shorter idle loops inorder to accommodate as many tasks as possible running simultaneously.

In most systems, the performance of the processor may be altered througha defined “throttling” process and through transitions into multiple CPUperformance states.

Certain CPU power management schemes are known which use statisticalmethods to monitor CPU host interface (sometimes known as Front-SideBus) activities to determine average CPU percent utilization and set theCPU throttling accordingly. However, advanced CPUs incorporate largecache memory that hide greater than 90% of the CPU activities within theCPU core. Therefore, the FSB percent utilization has little correlationto the actual core CPU percent utilization. As a result, priorimplementations cannot correctly predict idle states of CPUs withsuper-pipelined architectures and integrated caches.

If it is not known, in a most effective way, when the CPU may be powereddown, then it is not known when the CPU may issue any additionalread/write accesses to memory. Therefore, the memory may not be powereddown most effectively because, once the CPU issues a memory access, ifthe memory is powered down, performance may be jeopardized.

It is desirable to know, in an efficient manner, when the CPU is idleand the states of various memory-related functions in order to mosteffectively power down portions of the memory subsystem withoutcomprising system performance.

Further limitations and disadvantages of conventional and traditionalapproaches will become apparent to one of skill in the art, throughcomparison of such systems with embodiments of the present invention asset forth in the remainder of the present application with reference tothe drawings.

BRIEF SUMMARY OF THE INVENTION

Certain embodiments of the present invention provide a method andapparatus for performing adaptive memory power management in a systememploying a central processing unit (CPU) and a memory subsystem. Inparticular, certain embodiments provide for controlling the throttlingof the CPU and monitoring actual processes of the memory subsystem fromone time segment to another and determining which portions of the memorysubsystem to power down for at least the next time segment based on thethrottling of the CPU and the monitored memory processes.

An embodiment of the present invention provides for adaptively poweringdown portions of memory of a computer-based system employing a CPU and amemory subsystem. Determinations of whether or not the CPU is idle areperformed and memory access break events and pending memory read/writeaccesses are monitored to determine when to close certain memory banksand power down certain portions of the memory subsystem.

A method of the present invention provides for determining if a CPU of asystem employing a CPU and a memory subsystem is currently idle. Themethod also determines if any bus master initiated memory access breakevents have occurred and if there are any pending read or write accessesto the memory subsystem. Certain memory banks of the memory subsystemare pre-charged and closed based on the determinings, and certainportions of the memory subsystem are powered down when all the memorybanks of the certain portions are closed.

Apparatus of the present invention provides a CPU throttle control (THR)module to generate a CPU throttle control signal indicating when the CPUis idle. A memory controller (MC) module is also provided to generatememory power management signals based on at least one of the CPUthrottle control signal, memory read/write signals, memory access breakevents, and bus master access requests. The memory power managementsignals are used to power down certain portions of the memory subsystemwhen all of the memory banks of the portions are closed.

Certain embodiments of the present invention afford an approach toperform adaptive run-time memory power management for a system employinga CPU and a memory subsystem by controlling the throttle state of theCPU and monitoring memory-related signals and functions from one timesegment to another.

These and other advantages and novel features of the present invention,as well as details of an illustrated embodiment thereof, will be morefully understood from the following description and drawings.

BRIEF DESCRIPTION OF THE DRAWINGS

FIG. 1 is a schematic block diagram of an apparatus for achievingadaptive memory power management in accordance with an embodiment of thepresent invention.

FIG. 2 is a flowchart of a first portion of a method for achievingadaptive memory power management using the apparatus in FIG. 1 inaccordance with an embodiment of the present invention.

FIG. 3 is a flowchart of a second portion of a method for achievingadaptive memory power management using the apparatus in FIG. 1 inaccordance with an embodiment of the present invention.

FIG. 4 is a flowchart of a third portion of a method for achievingadaptive memory power management using the apparatus in FIG. 1 inaccordance with an embodiment of the present invention.

DETAILED DESCRIPTION OF THE INVENTION

FIG. 1 is a schematic block diagram of a memory power management system5 interfacing to a CPU 50 and a memory subsystem 60 in accordance withan embodiment of the present invention. Memory power management system 5includes a CPU throttle control (THR) module 10, an accelerated graphicsport interface (AGPI) module 20, a southbridge interface (SBRI) module30, and a memory controller (MC) module 40.

Other embodiments of the present invention may not include an AGPImodule or a southbridge module but may instead include other interfacesto interface to other subsystems.

In accordance with an embodiment of the present invention, the MC module40 includes a read/write buffer controller (FIFO) module 41, a DRAMcontroller (DRC) module 43, and a DRAM clock enable controller (CKC)module 42.

The THR module 10 performs CPU profiling, collects statistics of CPUperformance, and performs intelligent predictions to generate anadaptive CPU throttle control signal to control the throttling of theCPU. The THR module 10 controls the throttling of the CPU on a timesegment by time segment basis and communicates to the MC module 40 whenthe CPU is idle and whether there are any pending CPU memory accesses.U.S. Pat. No. 7,028,200 filed on May 15, 2002 is incorporated herein anddiscloses such a THR module.

In an embodiment of the present invention, the CPU throttle controlsignal comprises a CPU stop clock signal that is fed back to a STPCLK#signal input of the CPU. The CPU stop clock signal may be a digitallogic high during a portion of a run-time segment and a digital logiclow during another portion of the run-time segment. When the CPU stopclock signal is a logic high, the CPU begins processing and when the CPUstop clock signal is a logic low, the CPU stops processing.

As a result, the duty cycle of the CPU stop clock signal controls thethrottling of the CPU 10 on a time segment by time segment basis. Theduty cycle of the CPU stop clock signal is adjusted for each run-timesegment based on the most recently computed CPU throttle percentagevalue and CPU percent idle value for the last run-time segment (see U.S.Pat. No. 7,028,200). If it is known when the CPU is idle or powered up,then the memory subsystem 60 may be powered down as long as there are nopending bus master access requests.

As an alternative, if it is known when the CPU is powered down, then theentire memory subsystem may be dedicated to, for example, the graphicsand other input/output (I/O) subsystems.

In an embodiment of the present invention, AGPI module 20 interfacesbetween an AGP graphics device and MC module 40. The AGPI module 20generates break events and bus master accesses to inform the THR module10 and the MC module 40 that bus master devices need servicing. A busmaster directs traffic on a computer bus or I/O paths. The bus master isthe “master” and the target device being accessed is the “slave”. Thebus master controls the bus paths on which the address and controlsignals flow. In other embodiments of the present invention, the AGPImodule may instead be, for example, an interface module interfacingbetween the MC module 40 and a PCI device, a PCI express device, or a3GIO device.

In an embodiment of the present invention, SBRI module 30 interfacesbetween Southbridge/Bus Master/DMA devices and the MC module 40. TheSBRI module 30 generates break events and bus master accesses to informthe THR module 10 and the MC module 40 that bus master devices needservicing. A Southbridge is a chipset that manages the basic forms ofinput/output (I/O) such as Universal Serial Bus (USB), serial, audio,integrated drive electronics (IDE), and PCI bus in a computer-basedsystem. Direct Memory Access (DMA) is a capability provided by somecomputer bus architectures that allows data to be sent directly from anattached device (e.g. a disk drive) to the memory subsystem 60. The CPUis freed from involvement with the data transfer.

Other embodiments of the present invention are not restricted tonorthbridge/southbridge architectures, however.

The FIFO module 41 detects any pending read or write cycles from the CPUor bus master devices and stores memory access information. The FIFOmodule 41 decodes memory banks and memory rows to be accessed and alsoemploys least-recently used (LRU) logic. Decoding means that, when thereis a pending memory access, the FIFO module 41 may tell the CKC module42 which banks and rows are going to be accessed next. FIFO module 41may optionally include prediction logic to predict which banks are mostlikely to be accessed next and keep them open as long as necessary.

The CKC module 42 monitors the CPU throttle control signal and looks atinformation from the FIFO module 41 to determine which memory banks ofthe memory subsystem 60 (e.g. DIMM modules) are not going to be accessedany time soon and, therefore, may be closed. By monitoring the CPUthrottle control signal and information in the FIFO module 41, the CKCmodule 42 may determine whether the CPU is fully operational (On state)or in a power-down state (e.g. Stop Grant, Stop Clock, or Deep Sleepstates). The CKC module 42 also takes bus master access and break eventinformation from the AGPI and SBRI so any new or pending bus masteraccesses will command the CKC module 42 to instruct the DRC module 43 toprepare the DIMM 60 for an upcoming access.

The DRC module 43 controls the electrical interface and timing signalsto the physical DIMM modules 60, including memory power managementsignals. The DRC module 43 accepts commands from CKC module 42 topre-charge and close memory banks of the DIMM modules 60 and to powerdown certain portions of the DIMM modules 60.

In an embodiment of the present invention, the memory power managementsignals include clock enable (CKE) signals such that a correspondingmemory row of the DIMM modules 60 is powered down when its correspondingCKE signal is de-asserted.

In another embodiment of the present invention, the memory powermanagement signals include a packetized power-down command sent througha high-speed serial bus. Other embodiments of the present invention maycomprise other electrical/physical interface protocols.

In general, the CKC module 42 will look at the CPU throttle controlsignal to determine if the CPU 50 is idle (power down state). The CKCmodule 42 will also look at the AGPI 20 and SBRI 30 modules to determinewhether or not there are any pending bus master (BM) accesses or breakevents. The CKC module 42 also monitors the FIFO module 41 to determineif there are any pending read and write accesses from the CPU or busmasters. If none of this is the case, then the CKC module 42 may tellthe DRC module 43 to close either a memory bank, multiple memory banks,or the entire memory subsystem 60, depending on the detected conditions.

FIG. 2 is a flowchart of a first portion of a method for achievingadaptive memory power management using the apparatus in FIG. 1 inaccordance with an embodiment of the present invention. In step 110, thememory power management system 5 determines if the CPU 50 is idle. Ifthe CPU 50 is idle, then in step 120 the memory power management system5 determines if there are any pending bus master access requests. If so,then the CKC module 42 informs the DRC module 43 to complete the pendingbus master accesses (step 130) and then, in step 140, all memory banksare closed and the entire memory subsystem 60 (DIMM modules) are powereddown. If there are no pending bus master access requests, then the CKCmodule 42 informs the DRC module 43 to perform step 140 immediately andpower down the memory subsystem 60.

FIG. 3 is a flowchart of a second portion of a method for achievingadaptive memory power management using the apparatus in FIG. 1 inaccordance with an embodiment of the present invention. If the CPUthrottle control signal (e.g. STPCLK# signal) transitions from theassert state (CPU idle) to the de-assert state (CPU on) (step 310), thenthe CKC module 42 detects the change of the CPU throttle control signaland instructs the FIFO module 41 and DRC module 43 to prepare to processthe next CPU access to the memory subsystem 60 (step 320) since the CPU50 is being powered up upon the de-assertion of the throttle controlsignal.

FIG. 4 is a flowchart of a third portion of a method for achievingadaptive memory power management using the apparatus in FIG. 1 inaccordance with an embodiment of the present invention. If the memorysubsystem 60 is powered down (step 410) and there are any bus masterinitiated memory access break events detected by the THR module 10and/or CKC module 42 (step 420), then the CKC module 42 instructs theFIFO module 41 and DRC module 43 to prepare the memory subsystem 60 foran upcoming access (step 430). Next, it is determined if the CPU 50 maysnoop for bus master accesses (step 440). If so, then the CPU 50 goesahead and snoops (step 460). If not, then the CPU 50 may be put into apower state that can snoop bus master access (step 450) and then snoopsfor bus master accesses (step 460).

Microsoft et al. published the ACPI (Advanced Configuration PowerInterface) power management specification that is intended to provide astandardized, operating system-independent and platform-independentpower management mechanism to enable the OSPM (operating system-directedpower management) initiative. An ACPI-compatible operating system maybalance CPU performance versus power consumption and thermal states bymanipulating the processor performance controls. OSPM is very effectivefor peripheral device power management, such as for UARTs or modems,since OSPM knows whether the port is opened or the modem is in use.

The ACPI specification defines a working state in which the processorexecutes instructions. Processor sleeping states, labeled Cl through C3,are also defined. In the sleeping states, the processor executes noinstructions, thereby reducing power consumption and, possibly,operating temperatures.

Certain embodiments of the present invention are transparent to otherpower management protocols and are compatible with ACPI and OSPM.Certain embodiments of the present invention are independent of theoperating system and CPU. Certain embodiments of the present inventionprovide more effective power savings over traditional power savingsmethods but may co-exist with traditional auto pre-charge mechanisms.

The various elements of memory power management system 5 may be combinedor separated according to various embodiments of the present invention.For example, the FIFO module 41 and CKC module 42 may be combined toform a single module. Also, the AGPI module 20 and SBRI module 30 may becombined into a single module.

Also, the various modules may be implemented as various combinations ofsoftware and/or hardware modules.

In summary, certain embodiments of the present invention afford anapproach to perform adaptive memory power management for a systememploying a CPU and a memory subsystem by controlling the throttle stateof the CPU and monitoring memory-related processes and functions todetermine when to power down certain portions of the memory subsystem.As a result, higher CPU, I/O, and graphics performance may be achievedwhile saving power.

While the invention has been described with reference to certainembodiments, it will be understood by those skilled in the art thatvarious changes may be made and equivalents may be substituted withoutdeparting from the scope of the invention. In addition, manymodifications may be made to adapt a particular situation or material tothe teachings of the invention without departing from its scope.Therefore, it is intended that the invention not be limited to theparticular embodiment disclosed, but that the invention will include allembodiments falling within the scope of the appended claims.

1. In a system comprising a CPU and a memory, a method for performingadaptive power management of said memory, said method comprising:generating a CPU throttle control signal when a processor is idle;detecting a memory access signal; generating a memory power managementsignal based on said CPU throttle control signal and said memory accesssignal; and closing at least one memory bank in a memory row based onsaid memory power management signal, wherein said memory row may powerdown when all memory banks of said memory row are closed.
 2. The methodof claim 1, wherein said memory access signal is a memory read/writesignal.
 3. The method of claim 1, wherein said memory access signal is abus master access request.
 4. The method of claim 1, wherein said memoryaccess signal is a memory access break event signal.
 5. The method ofclaim 1, wherein an AGP graphics device generates said memory accesssignal.
 6. The method of claim 1, wherein a PCI device generates saidmemory access signal.
 7. The method of claim 1, wherein a 3GIO devicegenerates said memory access signal.
 8. The method of claim 1, whereinthe method further comprises placing said CPU into a power state thatcan monitor bus master access.
 9. The method of claim 1, wherein themethod further comprises completing any pending bus master read accessesand write accesses to said memory if said CPU is idle prior to closingmemory banks and powering down said memory row.
 10. A system comprisinga CPU and a memory, wherein the system further comprises: a firstcircuit operable to detect a memory access signal; a second circuitoperable to generate a CPU throttle control signal when a processor isidle and a memory power management signal based on said CPU throttlecontrol signal and said memory access signal; and a third circuitoperable to close at least one memory bank in a memory row based on saidmemory power management signal, wherein said memory row may power downwhen all memory banks of said memory row are closed.
 11. The system ofclaim 10, wherein said memory access signal is a memory read/writesignal.
 12. The system of claim 10, wherein said memory access signal isa bus master access request.
 13. The system of claim 10, wherein saidmemory access signal is a memory access break event signal.
 14. Thesystem of claim 10, wherein said first circuit comprises an AGP graphicsdevice operable to generates said memory access signal.
 15. The systemof claim 10, wherein said first circuit comprises a PCI device operableto generate said memory access signal.
 16. The system of claim 10,wherein said first circuit comprises a 3GIO device operable to generatesaid memory access signal.
 17. The system of claim 10, wherein thesystem further comprises a fourth circuit operable to place said CPUinto a power state that can monitor bus master access.
 18. The system ofclaim 10, wherein the third circuit is operable to close said at leastone memory bank and powers down said memory row after pending bus masterread accesses and write accesses are complete.